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(57) Abstract: A method to obtain the Pareto solutions that are specified by human preferences is suggested. The main idea is to 
2 convert the fuzzy preferences into interval -based weights. With the help of the dynamically- weighted aggregation method, it is shown 

to be successful to find the preferred solutions on two test functions with a convex Pareto front. Compared to the method described 
^ in "Use of Preferences for GA-based Multi-Objective Optimization" (Proceedings of 1999 Genetic and Evolutionary Computation 

Conference, pp. 1504-1510, 1999) by Cvetkovic et al., the method according to the invention is able to find a number of solutions 
^ instead of only one, given a set of fuzzy preferences over different objectives. This is consistent with the motivation of fuzzy logic. 
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Fuzzy Preferences in Multi -Objective Optimization (MOO) 

The present invention relates to a method for the 
5 optimization of multi-objective problems using evolutionary 
algorithms, to the use of such a method for the optimization 
of aerodynamic or hydro dynamic bodies as well as to a 
computer software program product for implementing such a 
method. 

10 . 

The background of the present invention is the field of 
evolution algorithms. Therefore, with reference to Fig, 1, at 
first the known cycle of an evolutionary algorithm will be 
explained. 

15 

In a step SI, the object parameters to be optimized are 
encoded in a string called 'individual'. A plurality of such 
individuals comprising the initial parent generation is then 
generated and the quality (fitness) of each individual in the 
20 parent generation is evaluated. In a step S2, the parents are 
reproduced by applying genetic operators called mutation and 
recombination. Thus, a new generation is reproduced in step 

53, which is called the offspring generation. The quality of 
the offspring individuals is evaluated using a fitness 

25 function that is the objective of the optimization in step 

54. Finally, depending on the calculated quality value, step 
S5 selects, possibly stochastically, the best offspring 
individuals (survival of the fittest) which are used as 
parents for the next generation cycle if the termination 

30 condition in step S6 is not satisfied. 

Before evaluating the quality of each individual, decoding 
may be needed depending on the encoding scheme used in the 
evolutionary algorithm. It should be noted that the steps S2, 
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The algorithm of this evolutionary optimization can be ex- 
pressed by the following pseudo-code: 



t := 0 

encode and initialize P(0) 
decode and evaluate P(0) 
do 

recombine P(t) 
mutate P(t) 
decode P(t) 
evaluate P(t) 
P(t+1) : = select P(t) 
encode P(t+1) 
t := t + 1 
until terminate 



Thereby, 

20 P(0) denotes the initial population size (t = 0), 

P(t) denotes the offspring population size in the t-th 

successor generation (t > 0) , 
t is the index for the generation number (t <s N 0 ) . 

25 Such evolutionary algorithms are known to be robust optimiz- 
ers that are well-suited for discontinuous and multi-modal 
objective functions. Therefore, evolutionary algorithms have 
successfully been applied e.g. to mechanical and aerodynamic 
optimization problems, including preliminary turbine design, 

30 -turbine blade design, multi-disciplinary rotor blade design, 
multi-disciplinary wing platform design and a military air- 
frame preliminary design. 
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For example, details on evolutionary algorithms can be found 
in "Evolutionary Algorithms in Engineering Applications" 
(Springer-Verlag, 1997) by Dasgupta et al., and "Evolutionary 
5 Algorithms in Engineering and Computer Science" (John Wiley 
and Sons, 1999) by Miettinnen et al . 

In the framework of the present invention, the evolutionary 
algorithms are applied to the simultaneous optimization of 

10 multiple objectives, which is a typical feature of practical 
engineering and design problems. The principle multi- 
objective optimization differs from that in a single-objec- 
tive optimization. In single-objective optimization, the 
target is to find the best design solution, which corresponds 

15 to the minimum or maximum value of the objective function. On 
the contrary, in a multi-objective optimization with 
conflicting objectives, there is no single optimal solution. 
The interaction among different objectives gives rise to a 
set of compromise solutions known as the Pareto-optimal 

20 solutions. A definition of 'Pareto-optimal 1 and f Pareto 
front 1 can be found in "Multi-Objective Evolutionary 
Algorithms: Analyzing the State of the Art" (Evolutionary 
Computation, 8(2), pp. 125-147, 2000) by D.A. Van Veldheizen 
and G. B. Lamont. 

25 

Since none of these Pareto-optimal solutions can be 
identified as better than others without any further 
consideration, the target in a multi-objective optimization 
is to find as many Pareto-optimal solutions as possible. Once 
30 such solutions are found, it usually requires a higher-level 
decisionmaking with other considerations to choose one of 
them for implementation. 
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Usually, there are two targets in a multi-objective 
optimization: 

(i) finding solutions close to the true Pareto-optimal 
solutions, and 

(ii) finding solutions that are widely different from each 
other. 

The first task is desired to satisfy optimality conditions in 
the obtained solutions. The second task is desired to have no 
bias towards any particular objective function. 

In dealing with multi-objective optimization problems, 
classical search and optimization methods are not efficient, 
simply because 

- most of them cannot find multiple solutions in a single 
run, thereby requiring them to be applied as many times as 
the number of desired Pareto-optimal solutions, 

- multiple application of these methods do not guarantee 
finding widely different Pareto-optimal solutions, and 

- most of them cannot efficiently handle problems with 
discrete variables and problems having multiple optimal 
solutions . 

On the contrary, the studies on evolutionary search 
algorithms, over the past few years, have shown that these 
methods can efficiently be used to eliminate most of the 
difficulties of classical methods mentioned above. Since they 
use a population of solutions in their search, multiple 
Pareto-optimal solutions can, in principle, be found in one 
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single run. The use of diversity-preserving mechanisms can be 
added to the evolutionary search algorithms to find widely 
different Pareto-optimal solutions. 

5 A large number of evolutionary multi-objective algorithms 
(EMOA) have been proposed. So far, there are three main 
approaches to evolutionary multi-objective optimization, 
namely, aggregation approaches, population-based non-Pareto 
approaches and Pareto-based approaches. In the recent years, 
10 the Pareto-based approaches have been gaining increasing 
attention in the evolutionary computation community and 
several successful algorithms have been proposed. 
Unfortunately, the Pareto-based approaches are often very 
time-consuming. 

15 

Despite their shortcomings, weighted aggregation approaches 
to multi-objective optimization according to the state of the 
art are very easy to implement and computationally efficient. 
Usually, aggregation approaches can provide only one Pareto- 

20 solution if the weights are fixed using problem-specific 
prior knowledge. However, it is also possible to find more 
than one Pareto solution using this method by changing the 
weights during optimization. The weights of the different 
objectives are encoded in the chromosome to obtain more than 

25 one Pareto solutions. Phenotypic fitness sharing is used to 
keep the diversity of the weight combinations and mating 
restrictions are required so that the algorithm can work 
properly. 

30 It has been found that the shortcomings of the conventional 
aggregation approach can be overcome by systematically 
changing the weights during optimization without any loss of 
simplicity and efficiency. Three methods have been proposed 
to change the weights during optimization to approximate the 

35 Pareto front. The randomly-weighted aggregation (RWA) method 
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6 



dividuals within the population and the weights are re- 
distributed in each generation. In contrast, the dynamically- 
weighted aggregation (DWA) method changes the weights gradu- 
ally when the evolution proceeds. If the Pareto-optimal front 
is concave, the bang-bang weighted aggregation (BWA) can also 
be used. In order to incorporate preferences, both RWA and 
DWA can be used. 

Randomly Weighted Aggregation 

In the framework of evolutionary optimization it is natural 
to take advantage of the population for obtaining multiple 
Pareto-optimal solutions in one run of the optimization. On 
the assumption that the i-th individual in the population has 

its own weight combination (wl(t), w^(t)) in generation t, the 
evolutionary algorithm will be able to find different Pareto- 
optimal solutions. To realize this, it can be found that the 
weight combinations need to be distributed uniformly and ran- 
domly among the individuals, and a re-distribution is neces- 
sary in each generation: 



w*(t) 



rdm (p) 
P ' 

1.0 - wf(t). 



wherein 



i 



denotes the i-th individual in the 



population (i = 1, 2, . . . , P) , 

is the population size (P e N) , and 

is the index for the generation number (t e N 0 ) . 



The function rdm (p) generates a uniformly distributed random 
number between 0 and P. In this way, a uniformly distributed 
random weight combination {w{, w\) among the individuals can 
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random weight combination wj) among the individuals can 

be obtained, where 0 < w{ , w L z < 1 and w{ + w x 2 = 1 . In this 
context, it should be noted that the weight combinations are 
regenerated in every generation. 

Dynamic Weighted Aggregation 

In the dynamically-weighted aggregation (DWA) approach, all 
individuals have the same weight combination, which is 
changed gradually generation by generation. Once the 
individuals reach any point on the Pareto front, the slow 
change of the weights will force the individuals to keep 
moving gradually along the Pareto front if the Pareto front 
is convex. If the Pareto front is concave, the individuals 
will still traverse along the Pareto front, however, in a 
different fashion. The change of the weights can be realized 
as follows: 

w x (t) = | sin (2 nt/F) | , 
w 2 (t) = 1.0 - w^t). 



where t is the number of generation. Here the sine function 
is used simply because it is a plain periodical function 
between 0 and 1. In this case, the weights w t (t) and w 2 (t) 
will change from 0 to 1 periodically from generation to 
generation. The change frequency can be adjusted by F. The 
frequency should not be too high so that the algorithm is 
able to converge to a solution on the Pareto front. On the 
other hand, it seems reasonable to let the weight change from 
0 to 1 at least twice during the whole optimization. 

In the above methods, it is assumed that all objectives are 
of the same importance. In this case, weights are changed 
between [0,1] in RWA and DWA to achieve all Pareto-optimal 
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solutions. However, in many real-world applications/ 
different objectives may have different importance. Thus, the 
goal is not to get the whole Pareto front, but only the 
desired part of the Pareto front. The importance of each 

5 objective is usually specified by the human user in term of 
preferences. For example, for a two-objective problem, the 
user may believe that one objective is more important than 
the other. To achieve the desired Pareto-optimal solutions, 
preferences need to be incorporated into multi-objective 

10 optimization. Instead of changing the weights between [0,1], 
they are changed between [*/"", , where 0 ^ vT in < nT* £ 1, 

are defined by the preferences. Usually, the preferences can 
be incorporated before, during or after optimization. In this 
invention, preference incorporation before optimization is 

15 concerned. 

As discussed in "Use of Preferences for GA-based Multi- 
Objective Optimization" (Proceedings of 1999 Genetic and 
Evolutionary Computation Conference, pp. 1504-1510, 1999) by 
20 Cvetkovic et al., the incorporation of fuzzy preferences 
before optimization can be realized in two ways: 

- Weighted Sum: Use of the preferences as a priori knowledge 
to determine the weight for each objective, then direct 

25 application of the weights to sum up the objectives to a 
scalar. In this case, only one solution will be obtained. 

- Weighted Pareto Method: The non- fuzzy weight is used to 
define a weighted Pareto non-dominance: 



30 



1 k 

U >z w V if and only if — 1^1^/^) £ 1 



with the utility sets 



WO 03/060821 ^PCT/EP02/14002 



U := {uj | i = 1, 2, 3, ... , k) for Ui e [0,1] and 
V := { | i = 1, 2, 3, ... , for yi e [0,1] , 

5 where 

f 1 for u ± > v s * 
^fa^ v d ) = \ and X = 1 • 

0 for Uj < i^i 

A general procedure for applying fuzzy preferences to multi- 
10 objective optimization is illustrated in Fig. 2. It can be 

seen that before the preferences can be applied in MOO, they 
have to be converted into crisp weights first. The procedure 
of conversion is described as follows: 

15 Given L experts (with the indices m = 1,2, ... ,L) and their 
preference relation g°, where is a {kxk) -matrix with p ±j 
denoting the linguistic preference of the objective Oi over 
the objective Oj (with the indices i,j = l,2 f ...,k). Then, 
based on the group decision-making method, they can be 

20 combined into a single collective preference Jf\ Each element 
of said preference matrix g is defined by one of the 
following linguistic terms: 



25 "much more important" (MMI) , 

"more important" (MI), 
"equally important" (EI), 
"less important" (LI), and 
"much less important" (MLI) . 

30 

For the sake of simplicity, the superscript c indicating the 
collective preference is omitted in the following text. 
Before converting the linguistic terms into real-valued 
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weights, they should at first be converted into numeric 
preferences. To this end, it is necessary to use the 
following evaluations, to replace the linguistic preferences 
Pij in the preference matrix, as indicated in "Use of 
5 Preferences for GA-based Multi-Objective Optimization" 

(Proceedings of 1999 Genetic and Evolutionary Computation 
Conference, pp. 1504-1510) by Cvetkovic et al. 

a is much less important than b => p±j = a, p j± = 0, 
10 a is less important than b => p±j = Y/ Pji = 5, 

a is equally important as Jb => Pij = £/ Pji = e. 



The value of the parameters needs to be assigned by the 
decision-making and the following conditions should be 
15 satisfied in order not to lose the interpretability of the 
linguistic terms: 

<x<Y<e=0.5<6<P, 
a+p = l= Y + 5. 

20 

Consider an MOO problem with six objectives { o x , o 2 , . . . , o 6 } as 
used in "Use of Preferences for GA-based Multi-Objective 
Optimization" (Proceedings of 1999 Genetic and Evolutionary 
Computation Conference, pp. 1504-1510) by Cvetkovic et al. 
25 Suppose that among these six objectives o x and o 2 , o 3 and o 4 
are equally important. Thus, there are have four classes of 
obj ectives : 



30 



Ci := {oi,o 2 }, c 2 := {o 3 ,o 4 }, c 3 := {o 5 } and c 4 := {o 6 }. 
Besides, there are the following preference relations: 



Ci is much more important than c 2 ; 
Ci is more important than c 3 ; 
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c 4 is more important than Ci; 

C3 is much more important than c 2 . 

From these preferences, it is easy to get the following 
5 preference matrix: 



P = 



( EI MMI MI LI \ 

ML I EI MLI ML I 

LI MMI EI LI 

^ MI MMI MI EI J 



From the above fuzzy preference matrix, the following real- 
10 valued preference relation matrix ^are obtained: 



R = 



r s p 5 y ^ 

a e a a 

Y 0 e y 

^ 8 p 8 e ) 



15 Based on this relation matrix, the weight for each objective 
can be obtained by: 

( \ S fa' 

20 with 



S {o dr R) := X 



i = 1,1 * i 



For the above example, this results in 

25 



+ 
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w, = 



w, = 



w K = 



p/ 2 = 



2 - a 
8 + 2a 

3a 



w< = 



8 -h 2a 
1 - a + 2y 



8 + 2a 

3 - a - 2y 
8 + 2a 



, and 



Since a and y can vary between 0 and 0.5, one needs to 
heuristically specify a value for a and y (recall that a < y) 
to convert the fuzzy preferences into a single-valued weight 
combination, which can then be applied to a conventional 
weighted aggregation to achieve one solution. 

In order to convert fuzzy preferences into one weight 
combination, it is necessary to specify a value for a and y. 
On the one hand, there are no explicit rules on how to 
specify these parameters, on the other hand, a lot of 
information will be lost in this process. 

In view of this disadvantage it is the target of the present 
invention to improve the use of fuzzy preferences for multi- 
objective optimization. 

This target is achieved by means of the features of the 
independent claims. The dependent claims develop further the 
central idea of the present invention. 

According to the main aspect of the invention, e.g. fuzzy 
preferences are converted into a weight combination with each 
weight being described by an interval instead of a single 
value . 



WO 03/060821 



13 



PCT7EP02/14002 



10 



Further objects, advantages and features of the invention 
will become evident for the man skilled in the art when 
reading the following detailed description of the invention 
and by reference to the figures of the enclosed drawings. 

Pig. i shows a cycle of an evolution strategy. 

Fig. 2 shows schematically a. procedure to apply fuzzy 

preferences in MOO, 
Figs. 3a, 3b show the change of weights {wx and w 2 ) with the 

change of parameter (a) , respectively, and 
Figs. 4a, 4b show the change of weights ( w 3 and w 4 ) with 

the change of parameters (a and y) , 

respectively. 

According to the underlying invention, linguistic fuzzy 
preferences can be converted into a weight combination with 
each weight being described by an interval. 



Figs. 3a, 3b, 4a, 4b show how the value of the parameters 
affects that of the weights. It can be seen from these 
figures that the weights vary a lot when the parameters (a, y 
) change in the allowed range. Thus, each weight obtained 

15 from the fuzzy preferences is an interval on [0,1]. Very 
interestingly, a weight combination in interval values can 
nicely be incorporated into a multi-objective optimization 
with the help of the RWA and DWA, which is explained e.g. in 
"Evolutionary Weighted Aggregation: Why does it Work and 

20 How?" (in: Proceedings of Genetic and Evolutionary 

Computation Conference, pp. 1042-1049, 2001) by Jin et al . 

On the assumption that the maximal and minimal value of a 
weight are w mjt and w min when the parameters change, the 
25 weights are changed during an optimization algorithm in the 
following form, which is extended from RWA: 
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wi(t) = < 



mln 




- w i )• 



rdm (P) 
P 



where t is the generation index. Similarly, by extending the 
5 DWA, the weights can also be changed in the following form to 
find out the preferred Pareto solutions: 



10 where t is the generation index. In this way, the 

evolutionary algorithm is able to provide a set of Pareto 
solutions that are reflected by the fuzzy preferences. 
However, it is recalled that DWA is not able to control the 
movement of the individuals if the Pareto front is concave, 

15 therefore, fuzzy preferences incorporation into MOO using DWA 
is applicable to convex Pareto fronts only, whereas the RWA 
method is applicable to both convex and concave fronts. 

To illustrate the underlying invention, some examples on two- 
20 objective optimization using the RWA are presented in the 
following. In the simulations, two different fuzzy 
preferences are considered: 



W(t) = < 



min 



+ (w? ax - wf n ) • I sin (2 nt/F) \, 



25 



1. Objective 1 is more important than objective 2; 

2. Objective 1 is less important than objective 2. 



For the first preference, one obtains the following 
preference matrix: 



30 



( 0.5 5 
£ = l 7 0.5 J' 
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with 0.5 < 5 < 1 and 0 < y < 0.5. Therefore, the weights for the 
two objectives using the RWA method are: 

K J(t) = 0.5 + 0.5.£^, 
5 wj(t) = 1.0 - wi(t). 

■ Similarly, the following weights are obtained for the second 
preference : 

, x rcta (p) 
10 wi(t) =0 + 0.5 

wi(t) = 1.0 - wt(t). 

To summarize, the invention proposes a method to obtain the 
Pareto-optimal solutions that are specified by human 

15 preferences. The main idea is to convert the fuzzy 

preferences into interval-based weights. With the help of the 
RWA and DWA, it is shown to be successful to find the 
preferred solutions on two test functions with a convex 
Pareto front. Compared to the method described in "Use of 

20 Preferences for GA-based Multi-Objective Optimization" 

(Proceedings of 1999 Genetic and Evolutionary Computation 
Conference, pp. 1504-1510, 1999) by Cvetkovic et al., the 
method according to the invention is able to find a number of 
solutions instead of only one, given a set of fuzzy 

25 preferences over different objectives. This is consistent 
with the motivation of fuzzy logic. 

Many technical, industrial and business applications are 
possible for evolutionary optimization. Examples for 
30 applications can be found e.g. in "Evolutionary Algorithms in 
Engineering Applications" (Springer-Verlag, 1997) by Dasgupta 
"et al., and "Evolutionary Algorithms in Engineering and 
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Computer Science" (John Wiley and Sons, 1999) by Miettinnen 
et al. 
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Claims 

1. A method for the optimization of multi-objective problems 
using evolutionary algorithms, the method comprising the 
following steps : 

- setting up an initial population as parents (SI) , 

- reproducing the parents to create a plurality of offspring 
individuals (S2, S3), 

- evaluating the quality of the offspring individuals by 
means of a fitness function (S4) , wherein the fitness 
function is composed of the sum of weighted sub- functions 
that represent an objective, 

- selecting the offspring (s) having the highest evaluated 
quality value as parents for the next evolution cycle (S5) , 

characterized in that 

during the optimization the weights for the sub- functions are 
changed dynamically respectively within a predefined interval 
for every weight. 

2. Method according to claim 1, 
characterized in that 

human preferences represented by linguistic preference 
relations are converted into parameterized, real-valued 
preferences relations to generate the intervals defining the 
allowed range of weight changes. 

3. Method according to claim 2, 
characterized in that 

•the parameterized preference relations are converted into 
real-valued intervals by letting the parameters take all the 
allowed value instead of assigning one specific value to each 
parameter . 



WO 03/060821 ^^CT/EP02/14002 

18 



4. Method according to anyone of the preceding claims, 
characterized in that 

the weights for the different objectives are randomly re- 
distributed within the defined intervals among the different 
offspring individuals in each generation. 

5. Method according to anyone of claims 1 to 3, 
characterized in that 

the weights for the different objectives are changed 
gradually within the defined intervals with the proceeding of 
optimization. 

6. Method according to claim 5, 
characterized in that 

the weights are changed within the intervals according to a 
periodic function . 

7. Method according to claim 5 or 6, 
characterized in that 

each offspring has the same weight in the same generation. 

8. Method according to anyone of claims 5 to 7, 
characterized in that 

the periodic change has the shape of a sine function applied 
on the generation number. 

9. Computer software program product, 
characterized in that 

it implements a method according to anyone of the preceding 
claims when run on a computing device. 

10. Use of a method according to anyone of claims 1 to 8 for 
the optimization of aerodynamic or hydrodynamic bodies, 
wherein different objectives have to be taken into account, 
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e.g. pressure loss and outlet angle calculated by a Navier- 
Stokes solver and geometric constraints. 
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Evaluate Decode 



Algorithm 
t:=0; 

encode and initialize P(0) 
decode and evaluate P(0) 

^recombine P(t) 
mutate P(t) 

decode P(t) 

evaluate P(t) 

P(t+1) = select (P(t) 

encode P(t+1) 

t:=t+1 
until terminate 



fig. l 
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